ONR:  Hoffman  &  Padberg  Final  Report 


1 


FINAL  REPORT  ON  GRANT  N0014-90-J-1324 
SUBMITTED  TO 

THE  OFFICE  OF  NAVAL  RESEARCH 
Arlington,  Virginia 

Submitted  -  August,  1996 


Solving  large-scale  combinatorial  optimization  problems 


Short  summary  of  research  under  Grant  N0014-90-J-1324 


Optimization  problems  are  concerned  with  the  efficient  use  or  allocation 
of  limited  resources  to  meet  desired  objectives.  These  problems  are  charac¬ 
terized  by  the  large  number  of  alternatives  that  satisfy  the  basic  conditions 
of  each  problem.  The  selection  of  a  particular  solution  as  the  best  solution 
to  a  problem  depends  on  some  goal  or  over-all  objective.  The  versatility  of 
the  combinatorial  model  stems  from  the  fact  that  in  many  practical  prob¬ 
lems,  activities  or  resources,  such  as  machines,  airplanes,  missile  target  sites, 
and  people  are  indivisible.  Also,  many  problems  have  only  a  finite  num¬ 
ber  of  alternative  choices  and  consequently  can  appropriately  be  formulated 
as  combinatorial  problems.  We  refer  the  reader  to  the  following  texts  and 
their  bibliographical  references  for  further  review  of  some  of  these  important 
engineering  and  managerial  decision  problems:  Combinatorial  and  Integer 
Programming  (Nemhauser  and  Wolsey),  Applied  Mathematical  Programming 
(Bradley,  Hax  and  Magnanti),  Principles  of  Operations  Research  (Wagner), 
and  Model  Building  in  Mathematical  Programming  (Williams). 

The  general  class  of  combinatorial  optimization  problems  we  have  stud¬ 
ied  and  are  relevant  to  the  strike-force  planning  problem  is  of  the  the  form 
of  a  pure  (0,1)  linear  programming  problem,  which  we  shall  refer  to  as 
Problem  Zjp : 

min  cx 

X 

\  subject  to  Ax  <b\x  €  {0,1} 
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where  A  is  an  mxn  matrix,  b  is  an  m- vector  and  c  is  an  n- vector. 

In  its  general  form,  Problem  Zip  belongs  to  the  class  of  NP-complete 
or  hard  problems  for  which  to  date  no  technically  good  (i.e.  polynomially 
bounded)  methods  of  solution  are  known.  While  in  terms  of  worst-case  anal¬ 
ysis,  Problem  Zip  may  remain  insoluble,  the  empirical  record  of  optimizing 
specific  instances  of  large-scale  problems  is  encouraging:  see  Crowder,  John¬ 
son  and  Padberg  [1983],  Grotscbel,  Junger  and  Reinelt  [1984],  Barahona  and 
Maccioni  [1982],  Martin  and  Schrage  [1985],  Martin  [1984],  Van  Roy  and 
Wolsey  [1985],  Balas  and  Ng[1986],  and  Leung  and  Magnanti  [1986],  Di¬ 
etrich  and  Escudero  [1988],  Monma  and  Grotschel[1990],  and  Padberg  and 
Rinaldi[1990]  and  Hoffman  and  Padberg[1992]  for  specific  problem  classes 
successfully  solved  and  Hoffman  and  Padberg  [1985]  and  Padberg  and  Ri- 
naldi[1990]  for  a  survey  and  overview  of  such  approaches.  Each  of  these 
papers  uses  cutting  planes  based  on  the  polyhedral  structure  of  integer  poly¬ 
topes  to  tighten  the  linear  programming  relaxation  of  Problem  Zip.  When 
it  is  not  possible  to  generate  any  further  cuts  (due  to  an  incomplete  under¬ 
standing  of  the  polyhedral  structure,  or  due  to  an  inability  to  generate  cuts 
of  a  known  form  algorithmically),  the  algorithms  resort  to  branch-and-cut  - 
the  use  of  cutting  planes  based  on  polyhedral  theory  into  a  general  search- 
tree  framework  whereby  cutting  planes  are  not  only  used  prior  to  branching 
but  also  within  the  search  tree.  For  details  on  the  development  of  branch- 
and  cut,  see  the  papers  by  Padberg  and  Rinaldi  [1987,1991],  and  Hoffman 
and  Padberg  [1989,1992,  1993,1995]  and  extended  to  a  parallel  algorithm  in 
Cannon  and  Hoffman  [1989]. 

It  had  been  presumed  until  recently  that  problems  having  more  than 
a  few  hundred  decision  variables  could  not  be  solved  to  optimality,  and  so 
heuristics  were  usually  employed  producing,  in  general,  suboptimal  solutions, 
i.e.  feasible  solutions  without  any  guarantee  as  to  their  “closeness”  to  a  best 
possible  problem  solution.  Results  of  research  performed  under  this  grant 
have  shown  that  problems  having  thousands,  and  sometimes  millions,  of 
variables  can  be  solved  using  present-day  technology  based  on  mathematical 
results  that  utilize  the  structure  underlying  the  problem  and  that  incorporate 
related  advances  of  the  mathematical  theory  into  the  general  approach  called 
branch-and-cut.  Such  algorithms  are  now  available  in  commiercial  software 
such  as  OSL  [IBM,  1992]  and  Cplex  [Cplex,  1993]. 
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Our  computational  successes  to  date  have  enabled  us  to  acquire  a  va¬ 
riety  of  real-world  problems,  when  it  was  believed  that  one  could  only  solve 
integer  programming  problems  having  a  few  hundred  variables,  industry  and 
government  organizations  proceed  to  use  “ad  hoc”  solution  procedures  and 
avoided  the  careful  modeling  of  the  “true”  optimization  problem.  Thus  data 
was  scarse  and  it  was  difficult  to  know  which  problem  areas  were  important 
to  the  applied  community.  It  is  precisely  the  successes  of  the  past  few  years 
that  allows  us  entry  into  the  applied  defense  community.  Seeing  new  prob¬ 
lem  areas  provides  us  with  a  stimulus  for  further  mathematical  developments 
which,  in  turn,  allows  the  solution  of  a  larger  set  of  important  combinatorial 
optimization  problems. 
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